Cyclic overlapping block coordinate search for optimizing building design

Block-Cyclic Stochastic Coordinate Descent for Deep Neural Networks

We present a stochastic first-order optimization algorithm, named BCSC, that adds a cyclic constraint to stochastic block-coordinate descent. It uses different subsets of the data to update different subsets of the parameters, thus limiting the detrimental effect of outliers in the training set. Empirical tests in benchmark datasets show that our algorithm outperforms state-of-the-art optimizat...

Effective Building Block Design for Deep Convolutional Neural Networks using Search

Deep learning has shown promising results on many machine learning tasks but DL models are often complex networks with large number of neurons and layers, and recently, complex layer structures known as building blocks. Finding the best deep model requires a combination of finding both the right architecture and the correct set of parameters appropriate for that architecture. In addition, this ...

Cyclic polymers as a building block for cyclic brush polymers and gels

On Faster Convergence of Cyclic Block Coordinate Descent-type Methods for Strongly Convex Minimization

The cyclic block coordinate descent-type (CBCD-type) methods, which performs iterative updates for a few coordinates (a block) simultaneously throughout the procedure, have shown remarkable computational performance for solving strongly convex minimization problems. Typical applications include many popular statistical machine learning methods such as elastic-net regression, ridge penalized log...

Cyclic Block Coordinate Algorithms for DOA Estimation in Co-Prime Arrays

In this paper, two cyclic block coordinate minimization (CBCM) algorithms to solve the problem of the direction-of-arrival (DOA) estimation in co-prime arrays are proposed. These algorithms are developed in the context of nonnegative gridless compressive sensing for overcoming the grid mismatch that conventional grid-based sparse methods suffer from. In their processes relying on atom merging a...